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ABSTRI^CT 

This paper details a computer managed program of 
instruction called Teaching Information 'Processing System (TIPS), as 
adapted to' an introductory psychology course. TIPS encourages the 
instructor tc formulate objectives for meaningf ul_ units of a 
course--ob jecti^es which should imply what changes in student 
behavior indicate mastery. Then multiple choice questions are written 
to assess student course- mastery. The TIPS prograia. uses each 
student's performance to generate a uniquely catered prescription 
detailing where performance is above, at, or below standard and what 
actions the student i? advised to take. Early work developing the 
program is reviewed as weilt- a^ student ratings of, TIPS, comparison of 
TIPS and non-TIPS classes, S4*lected samples of TIPS objectives, and 
qul« questions. Evidence is presented indicating' that TIPS seems 
neither to help nor hinder the "below-C" students, but those less 
well off J students are more satisfied with their edhucation in a TIPS 
course. They drop the course with fore precise reasons related to 
course content, and show a greater likelihood of re-e«rolling in the 
course in a subsequent semester than students who withdraw from a 
non-TIPS section, ( Author /FIfA) 
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Co pii 1 «5r - ru ax\a|{ c<.l i ns I ruction: 
IrKliiTl<hia)i^ij>g Introductory |>5ycholof^y for 1,000 «t fluents 
Richard A. Kaa«chnu~-and — Michael S. IIalpfi\n 

DniversiLy o( Houston ^ 
I introduce approximately Z,000 undergraduates a year to psychology at the 

University of Houston in a course that is offered in a large lecture format (to 5-600 

\ r * . 

studnints), but also via televisioh to xnotlier 5-600 students. We have now implemented a 

computer-based testing system called the Teachin^^ hvCormation Processmg System--6r 

TlPS-^^-ih order to increase our "personal" contact with each student. Today Vd like to spin 

the s\ory for you as to how we implemented the program, f5omethlng about our 

observajfions as to its effectiveness, and what the students' response to it has been. , \* 

First, let me describe the Introduction to -P,syc.hology coxirse for you, Ovor the past 

\ - / 

four years we. have enrolled^.^ average of 527 s{;udentjs per semester In our television 

■ ■ • t. ' ' 

section ^nd an average of 489 per semester in our lecture section. The course Is 

\prerequi»ite to almost all other courses offered by the Department, and it i.-? among ^ 

Ijimited number of Social Sciences' options in the curriculum of many of tKe University's 

1 ' . ^ ' ■ . / / ■ ^/ ■ 

Colleges. In a typical Fall semester students will be drawn from all /II ^colleges that 

ihclude undergraduates. 12.5% have a declared major in Social /^ciencea (4.Z9o in 

1 ■ / ' ' " / • ■ '\ • . 

pkycltiolo^), 3Z.6^ in Business . Administration (the largest single /source of. :^tudents)i 
li.l^'ln Natural Sciences/Mathematics, ^4.1% in Humajiities/FinyArt^jT aiidyf^^'j from 
ttk^ remaining seven colleges. Of those students, a typical breakdown i^" '5^.$^ first-^year 

/ stiidentrf, 23.8% sophomores, 1 3 J% juniors and 9.7% sentors a^d others. ,! Obviously, the 

' ^ . . / ^ 

baokgrpUnds and perspectives of my stud^ents are quite divers^! 
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y \cr{\\ro ticc{un\ inccls IwKr a wiw/i^s lor /'> p.m nu ! Usinj.; a < ours<« nut hue 

(VNjyniplr l^ycb, Kar>r>rhau, that im av.uUil^h^ to .sUulcnt.s, |.m^'^^ irAtv\r<^f; <uul 

cl(:nK)ns(raLionj&, accompanied by jx-rlii^p:^ H) ^u<.>vM^^s aiul appi oxuual <';y i,*lUU sluirs. U\c 
tolo vision scc(xon, insofar as I kno'^^'h virnqvu^ ('d'v<MMnK rxac (ly ihc n;^mr material (the 
l^svmple ^^>'aych book is used in both sections), U-^^^ lee turr /cUu^)on;Urat i<Mi material \s 
contained on '60 half-hour tcleyisio^^ tapes- These tapes are i^layed in pairs, with each duo 
])layed for two daya in a 48-scat rooju. The tapes are played 16 times during the (wo-day 
period according to a preannounced and ])ublisbcd ^ichcdule. Students enroll for the 
course, but choose (heir owmi viewing hours- -rest r u' ted only by the availability of sc^Us in 
the television room. (As an intriguing aside, our fitlendance figures indicate that wc 
teach about Z/3.s oT our students between 9 a-m,.and 3 p.m. although the t apes-^on^various 
schedules — have been available some seme^^tors as,:0<^Lr}y as 8 a.m. and rts late as 10 p.m.) 
A graduatci student is always in attendance in the teli^vision room. 

^l\e tapes — after trying many varieties — are i)layed back-to-back and followed by a 
15-minute period of discussion, 'in addition, in response to a graduate student s sAig^ekion, 
we now offer discussion periods at 10 a.m/ and I'AS p.m, five days a week with the 
students signing up for the section they wisli to attend. Tliis links each undergraduate 
with a specific teaching, fellpw and has a tangential benefit for TIPS to which IMl return, 
later. Lecture student^ are .informed of these voluntary discussion sections, but they are 
not required to attend., pa fact, attendance is voluntary for all our sections. Data 
indicates that in lecture — after the early semester enthusiasms/compulsions settles 
down--we hold 80-85% attendance. In the television section that Is slightly low- 
er__hovering around 80%, but Us slightly lower because 5-10% of the students repeat a 
viewing. So let's say attendancte in the television section is in th^ mid-TOs- • 

As5de from these (differences, students ai^e treated as similarly as possible: Each 
section is given three examinations during the semester, noncumulative and covermg 
about a third of the tdtal material in each exam. Students are also expected to do a 
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uui{' }H^mi(>n( proic^M vulun(*^-:M work, scrvip.j', ^^u, ,ni ur.< 1 <m }:r athi a I r rc-.iMi * h 
vvritinj,'. a UvriH j>.:v}><M a ]>ot»k *rUh}u<', XM^lopm^; an avul)o or vul<^' (sluic) d^MtiOuslra 
lion, or ( (uuluodnK a Mnail rrr.<>a.ri 'a }).rt>)<-t 1 ol owik Uj addition ihoy \\..\\ r an an ay 

ot o])lu)JU, {or (^xpc)sinK 1 h<MU.s<>l vos lo rorsrarch as .■Mib)<H ls, hstoninj.^, to and vicwmK 
tojcvisrd ipdcrvicvv.s witli lunf^ scholars, <\nd at((MKlinx, oc ea:ut>nal lrclur(\s l>y visilinj.; 
dignitarie-s--Jin) Ma C'oniuvU spokr to ( lu^ r!a:i.s<\s yoa_r hciovo. last, for inslaiu o- In sliorl, 
ovir students aro ()jf(M-od a div(M'St\ oon)pl<^x^ ox]H):^\,xro lo the discipline 

Ovu- course content goals l(nn--lo!d: (1) To faniiliar izo studenlr, with llic 

important terms and de (ini t ions- - 1 he !)as!C lang^JS^e of psychology. (Z)/ro encourage 
students to. learn about the basic research stratc^iee used by psychologists, especially as 
they are Applied in- the different content areas f^f our discipline. (3) To provide (he 
students with opportunities to see. the points in \%.h\v own life where thf principles and 
findings of psychology can be applied and to expofT(ti"''jthcm to procedures for making those 
applications-. And ultimately, (4) wc hope to convint^e our students that liuman and animal 
behavior is lawCul, subject to analysis and study. 

In terms oi process goals for my course, we 4jre hoping: (1) To challenge/encourage 



our! students-'-starting where they are — to move Jlhem forward in \uKlerst anding both 
the£nselves and psychology. [Z). To play to the students strengths--both intellectually and 
personally/ (Example: notice the vafiety of indpend|nt project options that are available 

to them). Finally, we hope (3) to personalize the course content and procedures to the 

•i 

largest extent possible. Fifteen-twenty nonoverlapping of free hours are offered each 

• V" ' ' 

week, coffee is for sale all the time the television roOm is operating, and I sit in at least 
twice (formally) and as many opportunities as I can make for myself to "Critique the 
teaching style of each of the graduate^students. / 
Neid for TIPS 

' S • The reasons underlying our decision to ithplemem the TIPS system were four-fold: 
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UuMiOil natur<^ o\ iht^ AvieviUii>lc lu^lj): 1 l\(^r(* <\rc only tMj.;h( tr<i< hmj^ {rUovsh and (mic ol u)o. 
1.5.) Wo had data uiduatmg that {\\c I (vu )hm- .sliuhsM t ion(,ul prr v^duc hum vv<vi> 
ai)i.>ro.Kinialely 0.4 per lu)ur(i). 1 should ronnnd yov^ of covirs^^ that ih(^ grachial^ studf^ntf^ 
arp available lZ-14 hours ])er day \u the television classroom --de])ending on the })recise 
iuhedule of Qperation we choo^ie- Finally, (4) the diverse nature of (he student.^ enrolling 
in oifr courije-'-as we hinted to you earlier- So we ini])lement5Hl TIPS on a pilot basis in 
Sj)ring 19V7 and formally for all students in both sections in Fall 1977. \V> are now 
entering'our tliird year of full-time operation with the system. And what is the nature of 
that system? 
TIPS System 

At its sin\plest, in order to implement a HPS system you must tell your students 
" what you wish them to learn, assist them in learning the material (by whatever means), 
and then assess whether they have mastered your/their material- Getting from that 
state ment of policy to an implemented system involves perhaps ^ two months* work, 
attendance at One two-day seminar, a computer of adequate capacity^ and some luck. 

In essence the major elements of the TIPS system are as follows. First, coijrse 
objectives must be laid out- I have * always had some reservations about "behavioral 
objectives", but one of the advantages of the large number of TIPS Quizzes the system 
allows is that instructor and 'student can reach a level of understanding as regards what is 
expected in terms of the Stated objectives f^ a course. In the abstract some of the 
content objectives for my course seem fuzzy or unmeasurable, biU as we gain experience 
with each 6ther, students seem to grasp what is intended by the specified objectives. 

Implicit in those objectives is one assumption that does not trouble rne: If vve are 
accomplishing something as educators, then it should show up as detectable changes in be- 
hayior,»if we can pose a question that will be answerable once our course materi.al has 
been mastered, but not otherwise. In short, I would maintain that education does have a 
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lit* ( ('( { .\1)1'<\ iiwMSurdhlc' nni>art n\\ ovir sliulrnt.'^, 

iHH-()i\<.l, having sj^orirwHl your i)h](^( i: ivrs it is Ihrn n(^c<\s.s<\r y to ^.;o) ( In ouj^h y^nir 
course uiaterial, objoclivo l)y <.)ljject iv<>, a>u! ^(Mun"at(» qu<\s(ion.s (or wlncli the ^tudcni 
rc'^pon.ses will indicate wlu:thcr the fjtudcnt ha.s inas((>r(ul ihv coiu.vpi. llcrr ov.c'<^^^\\\ as 
a quost ion-writer is pushed to th(- limit. In a iiionuMil I'll show you how/why. ^^vJ' 

Third comes the tricky part. If wo view the con^puter program as .'{iniply an 
uUorface between you as teacher and yoin- indnndual .students, you uuist now ask yourself, 
''W)\at woifld I tell this stuj^cnt to do or study if he/she got this question right? Wliat 
would I want to tell him/ber if it was missed^" The ajiswer to your own question deter- 
mines the nature of the next fjtep. 

n^c' be^luty of the TlPvS program is that^you can write "prescriptions" for your 
students in a staggering array of detail and sophistication, or very generally depending on 
time and inclination- T'^or example, if you've given a 10-item quiz, you may be interested 
only in encouraging tlie best and brightest to consider doing aj^ independent project and 
readiil^^ndependently on their own. If. so, you could instruct the computer to address such 
a message to those students .scoring in the top 5 or 10 or 30% of the class on your quiz- 
You might instruct the middle block of students to continue as they are, perhaps spending 
a little more time on the reading and course activities- And, you might instruct those 
students in the bottom 5 or 15 or 30% (yotj decide!) to" see you or to meet with a graduate 
assistant or visit the school's Reading Clinic- Which of these "prescriptions" is printed for 
each student can be determined on the basis of the percentile rank on a quiz or in terms 
of their absoKite score on a quiz — so that if everyone got 5 ^or more of the 10 items 

correct, they'd all get the same message- This same logic can be applied to subsets of 

\ ■ 

questions, or even to indiv idual questions! Again, the only; limit is your own ingenuity and 
available tipe. . , ' 

As a review for you, my course is composed of ten content se<!:tions: Methods and 
Data, Developmental, Physiological, Sensory Processes, Learning/Memory, Language, 



Mol u.'.ilion/linu^t ion, liulivulua! 1 )U i |M-(mum^.s/'J rst im^, . 1 'c^^ '-^^^Ji^^^it <^^^^1 S(k laL in .uUhli-n, 
c<n \\ ronleiU ar(V\ is aivuUM! into JO-nunuic locMurr .st^ j^nncnt;^ ]wn auso ( n.Mm o ol t hr 
it^h-VLSion oourao. -So, w)u-n ^unsiiiK 1 a lirSqinz^ wt^ abk the I IPS pr^ ^/i <vn^ Iv) analyst- 
student ])crronnanrc for cacli subset of quiz quciitions Uiai k^UiU^ to i>i\r 3()-nann.ile 
segment of mat er ial --usually two question<5. Thus, for rRch p:\\r of que.slKms \v(^ will 
generate either two or tlv.cc pre3Cr ipfion^— a.s5uming the student missed nor^e, one, or tUM3 
of the questions. As his/her performance deteriorates, the nature of the feedback 
heconios increasingly directed. . -even fo the point of saying "If you missed Question go 
back and read Pages 38-39 m Psychology and Life, and do activity it I on Page A-16 of 
^^£y niple Ps ych , " 

In addition to prescriptions based on a student's performance on individual 
questions, you can also ii\struct the computer to analyze the students perforniance on the 
entire quiz either absolutely or relative to his/her standing in class- FinalFy, you can also 
relay messages to the entire class--^of the upcoming iippearance of Jim McCo^nell in the 
lectiire section, of Visiting dignitaries in the department, or anything else you vvish to ci\\l 
to their attention — such as a Pabor Day vacation, or your own absence from the classroom 
so as to give paper in New York! 

Finally, the program will store the informatsion from each individual qui7;--~retain~ 
' ing up to 75 questions spread across 5 quizzes. Once we've finished Methods and Data, 
Developmental and Physiological, we have our first exam,. .Thus, after the computer has 
scored each student's third TIPS quiz we ask it to' review (he student's performance across, 
all questions relative to the class' performance as a whole. For the top 10% we send a 
"warm fu2:?y" that congratulates them on their performance thus far and suggests they re- 
lax and continue in their current form- For the middle 80°/^ we encourage more studying, 

No 

review of Psymple Psych , and re-reading the course text. For the bottom 10% we suggest 
an immediate appointment with. . .and the name of their discussion lellder (of the weekly 
session- for which they have signed up) is^filled in. If a satisfactory plan of study is not 
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d(nM-loi><M.K il (hry nu-tM \v!tl\ inr ,,iins.U is i a^. { <n-iiv Uu .irr wnahh- to stlwdul^' a]»p(nnl 
iiumU)^ wc mdiiaU^ IIkmi' ]w.m" ( ornuiiu sugj.^.fvs t s ihcy will iiavr sc^runi.s diiii< uUu^s wilh tlu» 
iirst exam and that \\\cy nnght vvi.sh (o consuirr droppmj^ the cnnir.sc, oi dolayin^^ (akin^.^, il 
[xn- another scrucstet. 

\n review, Micn, you firs! .sj)(H i(y objectives-- what arc you tryir^w^ to <\o(. c^u^.plisli \n 
your teaching? Then you write questions to assess student ])rogres<i toward accomplishing 
your objectives- Finally you write prescriptions intended to guule students toward better 
niastery o.( your object iv^es if their quiz performance indicates they're having some 
difficulties. Give tlie quiz, score it, hand out the prescriptions, and tlien wait lor the 
impact. 

There is an additional strong value to this tool--not immediat-eJy obvious--anc? 
(vinfot^tunately) not available to me in the television section. In addition to (he 
prescription sheets given back to the students, the computer gives each teaching fellow a 
listing of his/her students performance broken down by name and performance on each 
individual ^quest ion, as well as rt frequency distribution of his/her students' choices across 
each of the response options for all questions- Additionally, as instructor, I get a similar 
table for the entire class, without lYames- ^ ' . 



Thus, by wa4;ching the 




output I can monitor the teaching effectiveness of e^ch 



of the teaching fellows ancU (more importantly) I can instantly identify any concept or 
group of concepts the sfudents have not mastered. Tliat means I can review material 
. they've failed to master before moving on to new material based on a misunderstood 
principle or definition or concept! Thus TIPS makes the lecturing/teaching process self- 
correcting and responsive to student mastery of the subject matter- 

STUDENT RESPONSE IN THE CLASSROOM - . 

if " 
The syst-em was originally developed 10-12 years ago by Allen C. Kelley at the 

^ University of Wisconsin, 'then teaching a large-enrollment introductory economics with 

problems and limits similar those TVe described. My psychology course is divided into 10 



30-!uiiuilr lU^j-^Tuonls; iho Iniuic <(>\ir.sc ha.s a fiiimlar tl islMhvU ion. \\)\ <>a< h -.s^m luu^ ot the 
course -vve have published in an Aj)penaix in Ihe i'.^Yf^\pl^' rsyc h book a serirs ot ob]<M - 
live$--sKiUs Ihe sUulent .shouk! ^iMu wpou learning \hc nialeriab 'rypioAlly, \vr U^vc 
si>ecific<:l (wo objectives for (^ach JO-niinute lecture. As an example, in tb<^ "Basic 
conceptf?" portion ot il^e MK'VUODS'^N 1.) IjATA section the objectives are 3tat<M.l (hnf;t 
''At the time ot the '^T.lPS Quiz (witl) 80% accuracy) you should be able to: (1) Identify 
proper and improper examples of aj^ operational definition, ruul (2) Distinguish examples of 
indei^endcnt; i'jUer ven ing, and dependent variables given verbal descriptions of such 
variables or graphed versions of functional ro^Uor^iips." 

In order to assess the first objcctie, for instance, on the first llPvS quiz students 
are asked the foHowmg multiple-choice question: 
5) Which. of tJie follov/ing is an operational definition? 

1) speeding - travelling one mile l^'^s than two minlites where the posted speed is .30 
miles per hour ' * t 

Z) loving a feeling of joy 

3) smiling = occurs any time two good friends have not seen each other for a week 

4) testing = thinking ''one, two, three" every time you see a microphone 

* ' ... 

As we finish each section of course .material, the TIPS quiz is available for two 

days in th6 television ^classroom. 15~tninute discussion period followiiig^ the 

completion of a section of course material is utilized for administering the TIPS quiz in 

the television section; the first 10 minutes or so of the lecture section is similarly 

de'dicated. However/ students in both sections are allowed to take the quiz home if they 

prefer. In order not to delay card-punching and processing of the results, we . have, a 

* posted, absolute deadline after which no TIPS quizzes will be accepted for scoring. Once 

^ the' quiz has been cotnpleted, it is key-punched and entered with all students' data 

sinnultaneously. The single- or double-page printout is distributed during the night or 
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UMHlb<u k as NOon .\s jMv-^iijhU^ <i{t<M- {\\r i\i)H\ny\ (inw* lor su b nr. t ( inr, {lu'<[ui/. 

Thu] I'all is tlie iirst lunr vvo'vc^ allowcul (lu^ taiu' b.oint^ o}>{ low, so wm^ h.ivc nothuijc: 
yvi to vrport on that Oaturr. Howv-vcm", tOf>l^ MtM.unty hns Iwv-mi no prohhMn (or a very 
simnlo reason: ub crodil i-s ^iivcii for 1'IFS (,Hn7. prr { or ni ;\iu VVIumi t)u> systrin 15 

inh'odiu <nl, il is j)rcscntcd to th<^ sUideiU ar> a tool witli whirh iUoy ran ass(vss- -in a no- 
threat situat ion ' -how well th.oy arc progressing (ovvaid in<islory of nialorial Ihc course 
instructor deems iniportanU They are informed l-he qui/zcvs wili h(^ available, thai the 
questions will be sin)ilar to (but not identical with) qu(\stions to l)e asked on reguloi' 
examination.-?, 30 the te.'Jt-t aking experience certainly will help thorn. Cjenernl details 
about tlic nature of the prescriptions generated by the computer are also relayed, but not 
significant: amounts of information about the working details of the program. 

Our expcr.icnce in terms of student cooperation with the ground rules of Jhc TIPS 
system has been very positive. Tliere is no personal benefit to be gained by cheating, and 
we've found cibsolutely no evidence of cl^eating as the TIPS quizzes are being taken in the 
classroom- 

Student participation in the" TIPS quiz system declines during the semester, as one 
might expect. Preliminary analysis of student grades as a function of final course grade 
for those actually using TIPS suggests that students earning an A-grade for the course are 
^rforming 8-10% better than students earning As who took comparable course examina- 
tions during the yeajc preceding implementation of TIPS. For B students^ the increased 
exam performance is 3-5% higher. For C students as a group, as well as those earning a D 
or F in • the course, participating in' TIPS does not seem to influence their exam 
performance in the /course. , ' 

One unique aspect of the University of Houston bears on the apparent drop-out rate 
fro'm TIPS. In a 14-week semester, our undergraduates are able to drop a course until 
almost U weeks into the semester(!). As a result, doubtless, some students have Intel-- 
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l.n-tiially Mi-opixM!" ! !u« rouis-- vvrl! hclorc ( !u- I ! in v <•. s i ( v (aiu! i .i.s i ns! v ui. Ut ) get (orni.il 
word of the vvilhj^rawaK a (v}Mcm1 fUMUrsIrr, .startUij.^ witli SUO slvulcnt-,, W4> will a:^si|,M\ 
final gracl(.*s (other llum I or W) to only about (>()*^o ol tljeiu. Whorpa<i 88 90^"u of thr WO 
students at the* st^^rt of the ?ieinestor will taK<^ a 'VVrS quii, only S()-5Z'M) of the reouxining 
300 will p;xrticipate in the last group of T]Vy> Qurzvror,. it is diflicuU to pin-down the 
reason for this, but several have occurred to us. Virst, in^^a^t years it has been possible 
for students to avoid taking the final ex^^n ^under certain circumstances. Their 
"incentive" to continue -tll'S ir. likely to be reduced. Second, our initial 'Uratcgy in 
developing tbe original TIPS quizzes was to make them luarder than the actual examina- 
tions on which the students would be graded. We were concerned that since the TIPS 

y 

quizzef^ followed right on the heels of completing a section of material, it might be the 
case that stud[en^ perform ancc would top-out, causing the HPS system prescriptions to 
create imduc o])tiraism on ^le part of the students- To prevent this we seem to have over- 
reacted by making the TIPS Quiz questions too difficult- Class averages on each 
quiz— ranging from 8 to 15 questions in length reguhu-ly fall between 48-55%! Clearly it 
, has not been a public-relations, Trendcx success to give/take a TIPS quiz! Again, this has 
doubtless lessened participation. 

OveralT,~^t this''\^Doint we're two years into the -TIPS testing program. Student 
response -ha!§"^been very positive and the data we've collected seems to confirm our 
impression that the TIPS quizzes are having their i?i\cnded ^fect: Helpinft our students 
master \he course content and principles cff introductory psychology. 
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